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ABSTRACT 
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models with respect to these finite wordlength effects. 


PRECEDING PAGE BLANK NOT FILMED 


853 



Optimal q-Markov Cover for 
Finite Precision Implementation 

Darrell Williamson* and Robert E. Skelton** 


Abstract 

The existing q-Markov COVER realization theory does not take into account 
the problems of arithmetic errors due to both the quantization of states and 
coefficients of the reduced order model. All q-Markov COVERS allow some 
freedom in the choice of parameters. In this paper we exploit this freedom in the 
existing theory to optimize the models with respect to these finite wordlength 
effects. 


♦Dept. of Systems Engineering, Research School of Physical Sciences, Australian National 
University Canberra, ACT 2601, Australia 

♦♦School of Aeronautics and Astronautics, Purdue University, West Lafayette, IN 47907, U.S.A 


QSS 


PRECEDING PAGE BLANK NOT FILMED 



- 2 - 


Introduction 

An asymptotically stable system can be characterized in terms of its impulse 
response sequence (Markov parameters) and its output covariance sequence 
(covariance parameters) due to a zero mean white noise input process. A general 
approach has been developed [3] for realizing a system which matches q Markov 
parameters and q covariance parameters. Such a system is referred to as a q- 
Markov COVER, and q-Markov COVERS may be generated from output data 
[3,4] or from higher order models [5,6]. The Markov and covariance parameters 
are not independent and consequently the q-Markov COVER is not unique. In 
particular, all q-Markov COVERS are not related by state space similarity 
transformations [4]. In this paper we shall exploit the remaining degrees of free- 
dom to optimize the q-Markov COVER realization with respect to an aspect of its 
finite wordlength realization. 

Specifically, when digital controllers are to be implemented, both the con- 
troller coefficients and the controller states must be represented in finite 
wordlength precision. This finite wordlength (FWL) representation (or quantiza- 
tion) causes inaccuracies in the response when compared to the ideal (i.e. infinite 
precision) behaviour. Effects of quantization on the controller are increased noise 
at the output due to internal state quantization, and errors in time and frequency 
response characteristics due to coefficient errors. 

In digital filter design, the FWL effects are known to be most significant 
when the poles of the filter are very close to the unit circle [12]. In particular, 
narrow band filters have all these poles near z = 1+jo. For digital control, the 
zero-oider-hold equivalent of a continuous time model (or controller) with a pole 
at X will have a discrete pole at exp (XT). Hence for fast sampling and/or low 
damping of the continuous models, the discrete model will behave like a narrow 
band filter. The synthesis of optimal digital controllers with respect to 
arithemetic quantization noise is an important consideration in design especially 
for continuous time systems operating under a fast sampling rate [9,10]. The 
effects of quantization depend highly on the structure of the controller. This 
paper seeks to reduce these errors in the synthesis of q-Markov COVERS. 

1. Discrete q-Markov COVER 

Consider the asymptotically stable nominal discrete system 
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x(k+l) = Ax(k) + Bu(k) ; x(k)eR* u(k)eR n ' 

y(k) = Cx(k) ; y(k)eR ,v (L1) 

where {u(k)J is a zero mean process with unit intensity E |u(k)u*(j)} - I8y and 
E {x(k)u*(j)} = 0 fork^j. The Markov parameters Mi and covariance parameters 
Rj of (1.1) are defined by 

Mi = CA 5 B ; Rj = CA j XC*, j £ 0, Rj = CXA* j C*, j*0 (1.2) 

where the state covariance matrix X satisfies the Lyapunov Equation 

X = AXA* + BB* . (1.3) 


These parameters Mi and Rj appear as coefficients in the expansion of the transfer 
function H(z) and power spectral density H(z)H*(z -1 ); that is 


H(z) = C(zI-Ar 1 B = £M i z^ (i+1 >; H(z)H*(z)= £ RjZ“j 

i=0 

We suppose that as data we are given the first q-Markov and first q-covariance 
parameters {M^ Rj; i = 0, 1, .... q-1) of an asymptotically stable system from 
which we construct the two data matrices 


£> q = * q - MJi'eR**** 

D q = /? q -MqM* eR"^ 

where R q , M q and M q are the Toeplitz matrices of the data as: defined by 

Ro Ri ... R<f-i 

Rl Ro •.. Rq-2 



R^i Rq-2 ... Ro 



0 0 ... 0 o' 


Mo 0 ... 0‘ 


Mo 0 ... 0 0 


M x Mj ... 0 


Ml Mq 

• • • 

• • • 

• • • ••• 

,M q = 

• • • • 

• • • • 

• • • • 

H-2 0 


Mq_2 M,j_3 ... M„ 0 


Mq_i Mq.j ... Mq 


(1.4a) 


(1.4b) 


The first data matrix D q in (1.4a) is Hermitian and it is shown in [3-4] to be 
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positive semidefinite. Hence we can obtain a (nonunique) full rank factorization 


Dq = P q P q *; PqfiR^, 

(1.5a) 

where 


r q = rank (D q ) = rank(P q ) £ n y q 

(1.5b) 

If we partition P q according to 


Pq = [E q F q ]; E q eR n ^, F q eR (q-1 ^ 

(1.6) 

then it follows that the second data matrix D q can be factored as 


Dq = P q Pq*; P^R"*”' 

0.7) 

where 


Pq = [F q Gq]; G q eR^ 

(1.8) 


for some G q (to be determined). The following result has been established. 
Theorem 1.1 [3] 

Given the q Markov parameters {Mj; i = 0,1, .... q-1 ) and the q covariance 
parameters {Rj; i = 0,l, ..., q-1) and a matrix G q in (1.8) such that (1.7) is 
satisfied, then the realization { A q , B q , C q } of order r q defined by 

A q = P q + P q ; B q = P q [Mo ‘ • ' K-J*; C q = E q (1.9) 

where P q denotes the Moore-Penrose inverse of P is a q-Markov COVER. The 
corresponding controllability grammian Xq is given by 

X q = I (1.10) 

Furthermore 

Pq = [C q A q *C q # "*(AfVC q T (1.11) 


rrn 

This theorem describes a large but not complete class C q of q-Markov COVERs 
parameterized by (G q ) such that for some E q ,F q the data matrices D q , D q satisfy 
(1.5)-(1.8). Each matrix G q will (generally) result in a q-Markov COVER having 
a different transfer function. In order to compute the set of all such G q , observe 
in (1.5)-(1.8) that 
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D q = 


[Eq Fq] . 


(1.12a) 


Then 



Dq-1 

5. 



D q = 


dqq 

= 

[oj 


[Fq G q *] 


(1.12b) 


implies 


dqqe/?^ 

EqEq = Rq , F q Fq = F q Gq = d q , G q G* = dqq (1.13) 


Now expand D q in terms of its singular value decomposition 


D q = (U 1 U 2 ) 


* ' 

It 0 


p ^ 

u; 

0 0 
V 4 


u 2 ‘ 

h d 




Then from (1.12a) 


(EqFqVl^Ur 


(U4) 


(1.15) 


so that E q = C q is defined by the first n y rows and F q by the last (q-l)n y rows of 

UiEi 1/2 . Define 


Then from (1.15) 


p q = rank (F q ) 


p a ^min(r ,(q-l)n ) 


(1.16a) 


(1.16b) 


Next, expand F q in (1.13) in terms of its singular value decomposition. If strict 
inequality occurs in (1.16b) we have 

- r v:l 


Fq=[U 0 Up] 


Zq° 

0 0 


; ZqS/i 




The Moore-Penrose inverse F q of F q is then given by 

F^VaZq^Ua 


(1.17) 


(1.18) 
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\ 


Define 

(i) G ql = (Fq d,)* e R*** 1 * (1.19) 

(ii) G q2 such that G q2 G* 2 ^ dqq-dq‘5^^ 

where 


S q = rank [dqq - dq] 

and 

(1.20) 

(iii) G q3 = Vpe* (r,-P,)xr '. 

(1.21) 

Then if strict inequality occurs in (1.16b) the set of all G q which satisfy (1.13) are 
given by 

G q = G ql +G q2 U q G q3 

where 

(1.22a) 

Uq € ; Sq ^ r q - pq ^ Tly 

(1.22b) 

is an arbitrary row unitary matrix (i.e. U q U q = I). Furthermore, 
Penrose P q of 

if the Moore- 

Pq=[E q * F*]* 

is expressed as 

(1.23) 

P,* = [L„ L 12 ] ; L l2 € 

(1.24) 

then the corresponding state space representation {A q , B q , C q ] of the q-Markov 
COVER is given by 

A, = L n + L^q ; L u = L n F q e r< * xr ‘* 

B q = P q + [MoX ••• M^j]*; Cq = E q . 

If r q = p q , then G q = G ql is unique. 

Proof: The expression forF q G q in (1.13) implies G q is of the form 

Gq* = F q + dq + G*,M*; 

for some M. Then expanding G q G q using (1.13) we have 

(1.25) 
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dqq = dqV^Fjd, + ^(FJ)*G£m* + MG q3 F q + d q - MG q3 G q3 M* 

Also from (1.13) and (1.21) 

(F£*FJ = D*,, G qJ G *j = I ; (F,*)'G*, = 0 (1.26) 

so that 

MM* = dqq - d q (F q )*F q dq 

Since MM* has rank s q , 

s q = rank(G q2 G q2 ) £ r q - p q 

2. Optimal Finite Wordlength q-Markov COVER 

A fixed point finite wordlength realization of the idea) (i.e. infinite precision) 
q-Markov COVER (1.1) shall be referred to as a q-FWL Markov COVER and is 
described by 

x(k+l) = AQ[x(k)] + Bu(k) 

y(k) = CQ[x(k)] (2.1) 

Q[x(k)] = x(k)-e(k) 

A A 

where e(k) is the error in computing x(k). The components of the matrices A, B, 
£ are assumed to have a W 0 bit fractional representation Obtained by quantization 
of the components of A, B, C in (1.1). The components of x(k) have a W+W 0 bit 
fractional part while components of Q[x(k)] and u(k) all have a W bit fractional 
part The components of the state residue vector e(k) has a W+W G bit fractional 
representation in which the most significant W bits are zero. The LHS and RHS 
of (2.1) are therefore consistent with respect to their fractional wordlength 

A A 

representation. The number of bits required to represent the integer parts of A, B 
and £ depend on the dynamic range of the coefficients. State space structures in 
which all coefficients are less than unity are therefore advsintageous in this regard. 
The required integer representation of Q[x(k)] will depend on the dynamic range 
of the input signal 6(k). Inadequate dynamic range will result in arithmetic 
overflow. The accuracy in the computation of x(k) is determined by its fractional 
wordlength W. 

Define the state error vector e,(k) and output error vector £y(k) by 
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e.MaOO-xd); £y(k> — ^(k) — y(k) (2.2) 

Then from (1.1), (2.1) and (2.2) 

^(k+l) = ACjjflc) - Ae(k) + AAQ[x(k)] + ABu(k) + BAu(k) (2.3) 
£y(k) = Ce x (k) - Ce(k) + ACQ[x(k)] 

where 

AA = A - A; AB = B-B; AC = C-C 
Au(k) = u(k) -u(k) 

There are five terms which contribute to the output error (i) internal arithmetic 
errors e(k) due to state quantization (ii) coefficient errors due to errors AA in A 
(iii) AB in B (iv) AC in C, and (v) input quantization errors Au(k). Under weak 
’sufficiently exciting’ conditions on the input (u(k)} it can be shown [6] that if 
Q[-] in (2.1) denotes ’roundoff* quantization, then (e(k)} is a zero mean uniform 
white process with covariance 

B(e(k)e , (k))=Y 2 I; Y 2 =-^-2‘ 2W - (24) 

Similarly (Au(k)) is assumed to be a zero mean white uniform process with 

E (Au(k)A*u(k)} = 7*1 (2.5) 

We assume that the quantized coefficients A, B, C are obtained by rounding A, B, 
C to W c bit fractions. Consequently, all components Ap of the error matrices AA, 
AB, AC satisfy 

IApl <Y 0 ; Yo = y 2 -W * . (2.6) 

For simplicity we normalize the error matrices and define 8A, 8B, 8C by 

8A = — AA; 8B = — AB; 8C - — AC (2.7) 

Y 0 Yo Y 0 

so that all components 8p of SA, SB and SC satisfy 

I Sp I < 1 . (2.8) 

The steady state output error covariance Y of (£y(k)} is then given by (we assume 
independence of e(k), e(k) and x(k)). 
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Y = CPC* + ^cc* + Yo^SCKXVDCSC)* + Yo^[C(fiC)* + (8C)C*] , (2.9) 

where 

P = £(e,(k)e,'(k)) 

= APA* + -fkK’ + Y^SAXX+flXSA)' + y 2(8B)(8B)" + /BB* 
and 

X = E (x(k)x*(k)} = AX(A)* + ^(A)* + (l-py^BB* 

For the remainder of this section we assume no coefficient errors (i.e. Yo = ® 
(2.9)) and consider only the effects due to finite state wordlength (FSWL). The 
issue of coefficient error shall be resumed in Section 4. 

Theorem 2.1 


Define the output noise measure 



J = tr[Y] . 


Then for y Q = 0 

J = T 2 { tr[K] + tr[B*KB] } 

(2.10) 

where 

K = A*KA + C*C. 

(2.11) 


Proof: From (2.9) 

Y = CPC*; P = APA* + V 2 Z = P + Y 3 I 


where 


Now 


and 


so that 


Z = I + BB*; 


P = y 2 £ A k Z(A k )* 

k=0 


K= £ (A k )*C*CA k 

k=0 
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tr[CPC*] = ACZK) . 


A fixed point q-FSWL Markov COVER corresponding to the (ideal) q- 
Markov COVER (1.1) is therefore described by 

x(k+l) = AQ[x(k)] + Bu(k) 

y(k) = CQ[x(k)] (2.12) 

Q[x(k)] = x(k)-e(k) 

The output noise gain (r| x ) due to state quantization and the output noise gain 
(q u ) due to input quantization are defined by 

= tr[K]; q u ^tr[B*KB] (2.13) 

The noise gain q x generally varies with state space representation whereas Tl u is 
independent of the coordinate basis. Specifically, consider the q-FSWL Markov 
COVER 

z(k+l) = A Q[z(k)] + B u(k) 

y(k) = C Q[z(k)] (2.14a) 

Q[z(k)] = z(k)-f(k) 

where 

A = T' 1 AT, B = T^B, C = CT (2.14b) 

and Q[z(k)] has a W bit fractional representation. Assuming ’sufficient excita- 
tion’ by u(k), the state residue sequence (f(k)} in (2.14a) due to roundoff quanti- 
zation will again be a zero mean white uniform process with covariance as in 
(2.5). The corresponding output quantization noise gains T| z and rj u due respec- 
tively to state and input quantization are given by 

tl z = tr[KJ; ii u = tr[flXfl] (2.15) 

where B is given by (2.14b) and 

K Z = AK Z A* + C*C . (2.16) 

But from (2. 11), K^ = T*KT, so that 
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Ti z = tr[T*KT]; r\ u = tr[B*KB] (2.17) 

Notice from (2.13) that the noise gain T] u due to input quantization errors is unaf- 
fected by a similarity transformation. Conversely the noise gain Ti x due to state 
quantization generally changes with co-ordinate bases. There is no change if T is 
unitary. The q-FSWL Markov COVER (2.14) is superior to the q-FSWL Markov 
COVER (2. 12) if 

Tl z <TV (2.18) 

However the comparison in (2.18) must be made under the assumption of identi- 
cal scaling of the states x(k) and z(k). Specifically, equal 1 2 - scaling of gain a 
from a zero mean unit intensity white noise input u(k) to the state components 
Xj(k) of x(k) requires 

Xjj = a for all j (2.19) 

where Xjj denotes the jth diagonal component of the state covariance matrix X 
given by (1.3). Equal l 2 -scaling of gain a of components of z(k) in (2.14) 
requires 

Z_y = a; Z = AZA * + BB* (2.20) 

Equality in l 2 -scaling of representations (2.12) and (2.14) is equi valent to equality 
in the state dynamic range (i.e. number of bits in the integer representation of 
states) for a given probability of overflow. We now state a result which is impor- 
tant for establishing l 2 -scaling. 


Lemma 2.1 [8,9] Suppose M = M* > 0 is an nxn matrix. Then a necessary and 
sufficient condition for the existence of a unitary matrix V such that 

VMVjj = a for all j 


is 


tr[M] = na 


□□□ 

We have shown in Lemma 1.1 that different similarity transformations of an 
ideal q-Markov COVER corresponds to different factorization of the first data 
matrix D q in (1.5a). Our aim is to optimize this factorization. 

Definition 2.1 
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The Optimal q-FSWL Markov COVER minimizes the output quantization 
noise gain T| due to state quantization errors; that is 

il opt = min tr[T*K q T]; T*T = A -1 (2.21) 

T.O, 

subject to the l 2 -scaling constraint: 

Ajj = a for all j (2.22) 

where the observability grammian Kq satisfies 

K q = A*K q A q + C*C q (2.23) 

with { A,, B q , Cq} defined by (1.22)-(1.25). 

non 

In corollary 1.1 we have shown that all the degrees of freedom available to 
select G q are confined to an arbitrary row unitary matrix U q . We now show how 
to optimize U q . 


Theorem 2.1 

a. The optimal q-FSWL Markov COVER (1 .25) is defined by 

Tl op t = r q 1 min (tr[KqJ*]) 2 (2.24) 

where U q e is an arbitrary row unitary matrix and Kq satisfies 

(2.23). 

b. The transfer function of the optimal q-FSWL Markov COVER has Hankel 
singular values given by the eigenvalues of Kq defined by the minimizing 
U q . 

c. Suppose U q = U qo is the minimizing solution corresponding to the optimal 
G q = G qo in (1.22a). Let {Aq 0 , Bqo. C q0 ) be the corresponding state space 
realization in (1.24). Then the optimal q-FSWL Markov COVER has a 
(nonunique) state space representation {T^Aq^, T“ 1 B qo , C qo T} where 

T 0 = U 0 tc 0 V 0 * (2.25) 

such that 


(i) the unitary matrix U 0 is defined by 
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UoKqoU^Io 2 (2.26a) 

where 

Kqo = ^qo^qo^qo ^qo^qo * £o = ^®8(®10* ®j[0> •••* ®r^)) (2.26b) 

in which {o£} are the optimal Hankel singular values (eigenvalues of K^). 

(ii) 


k=i 

and (iii) V 0 is unitary such that 


r < 

E«k» 

< v „Eo V o)jj= j 2 i — for all j 
r q 


(2.27) 


(2.28) 


Tlopt - Tl q (optimal) = -j- ( £ OjJ 1 
“r a lc=l 


(2.29) 


Proof: By corollaiy 1.1 we have for G q defined by (1.22) for any row unitary 
matrix U q (of appropriately specified dimensions) that C> q defines a q-Markov 
COVER. The corresponding realization { A q ,B q ,C q ) for each such U q has identity 
controllability grammian and observability grammian Kq defined by (2.23). Now 
given a particular U q , apply a similarity transformation 

T = U 0 Jt 0 V 0 * 

to the given q-Markov COVER. Then 

tr(T*K q T) = tr(7C 0 2 U 0 *K q U 0 ) 
and 

<j*tt 1 =v 0 k; 2 v; 

By lemma 2.1, the l 2 -scaling constant can be satisfied for some V Q provided 
tr(7t“ 2 ) = not. Following Williamson [1, Theorem 4.1] (with a minor modification 
of the 1 2 - scaling constraint), the optimal performance is given by 
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r t , 

(I°j > 2 

0=1 



where {o 2 } arc the eigenvalues of Kq. That is, 

tr(K q ls )=2<J j 

j=l 


The optimal q-FSWL Markov COVER therefore achieves the minimum in (2.24). 
The structure of U 0 , n 0 , V 0 in (2.25)-(2.29) follow directly from Williamson [1] 
(see proof of Theorem 4.1 with U = I). 


3. Computation of the Optimal FSWL Markov COVER 

Necessary conditions for the optimal solution in Theorem 2.1 can be 
obtained using the method of Lagrange multipliers. Specifically, let 

J = (tr[K*]) 2 + tr[A(-K q +A*K q A q + C*C q )] + tr[Q(I-U q U*)] (3.1a) 

where 

Kq = K^ 4 Kj 4 * A = A* e « rft , O = O* e R (3.1b) 

are symmetric Lagrange multipliers. After taking derivatives of J using (1.22) 
and (1.25) 

|U -K, + A,'K, A, +C& 


= 21 - 2AK^ + 2A q AA*K^ (3.2) 

dKq 

= 2G’ 2 L,' 2 K,A <( AG q , 3 - 2J1U, 

By setting these derivatives to zero we obtain the following result 


Lemma 3.1 Necessary conditions for the derivation of the optimal q-FSWL Mar- 
kov COVER are given by 
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K q = A*K q A q + C*C q 
A = A q AA q * + K^*; A = A *eR T **' 

U q U* = I ; U q e^ v(r ^ (3.3) 

QU q ~P q U q Q q = R q ;fl = Q*e/?W 

where 

p, = P,' = O^L^LuG^ 

Q, = Q,” = G,jAG; 3 e **<-*>***> (3.4) 

R, = G; 2 L; 2 K,(L 11+ L 12 G ql )AG‘ 3 e R 
and A q , Gqj, Ly are defined by (1.20)-(1.24) 

□□□ 

These necessary conditions cannot be solved explicitly lor the optimal row 
unitary matrix U q and so an iterative procedure is required. One possible algo- 
rithm is now described. 

Recursive Algorithm for Optimal q-FSWL Markov COVER: 

(0) Set j = 0 and choose any row unitary U q (0) in (1.21a) 

(1) Form Aq(j) from 

Aq(j) = (Ln+ L 12 G ql ) + L 12 G q2 U q (j)G q3 (3.5a) 

(2) Compute K^Q): K x (j) = A q *0)K q (j)A q (j) + C q C q (3.5b) 

(3) Compute AQ: AO)=A q 0A(j)A q a)+K q - V4 (j); AQ) = A*0) (3.5c) 

(4) Compute PqOXQqO) RqO): 

PqO) = GiLi2Kq(j) L i 2 G q2 ; Qq(j) = G q2 AQ)G^, 

RqO) = G q2 L 1 * 2 K q a)(L 11 +L 12 G ql )A0)G q *3 
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(5) Update U q (j) by solving the nonlinear algebra problem: 
G(j)U q (j+i) - P q (j)u q a+UQq(j) = Rq(i); «(j) = n*(i) (3-5e) 

U q (j+l)U*(j+l) = I 

The most difficult step at each stage of the algorithm is to solve (3.5e) for a row 
unitary U q (j+1) and symmetric Q(j). There is generally no explicit solution 
except for the following special cases. 


Lemma 3.2 Consider the equation 

QU q -P q U q Q q = R q ; QeR s ^ (3.6) 

where 

P,=P,'s i Q,=Q,*« R,€ rWW (3.7) 

are given. Then there exists an analytical solution (Q,U q ) with Cl symmetric and 
U q row unitary when s q = 1 or Qq = pi. (p scalar) 

a. When s q = 1, O and P q are scalars and Rq is a row vector. Then U q is arbi- 
trary for Rq = 0 while for Rq * 0 

U q =Rq(QI-PqQ q r 1 ; IIU q ll = 1 (3.8) 


b. 


When Qq = pi, let RqR^ have the singular value decomposition 


rX=(v 1V2) 


Zql 0 

. 0 0 



where 2qj is invertible. Then 

U^WVlq-pV.X; Q = pP,+ViJ^Vj 

In particular, when RqR^ has full rank, 

U q = (R q Rq*)"X 


(3.9) 

(3.10) 


Proof: For case (a) 

U q (m-P q Qq) = R, ; Cl scalar 

so that (3.8) follows by the row unitary property U q U q = I. In case (b) 
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(Q - pP q )U q = Rq 

and using the row unitary property of U q 

(Q-(3P q ) 2 = R q R * 

Hence using the SVD of RqR^ 

ViSS}v,'u,=Rq 

But V* = I and W* has full row rank which gives (3.91. 

□CD 

Strictly speaking, (3.8) is not an analytical solution since the scalar C2 must still 
be chosen so that IIU q ll = l. Note that by Corollary 1.1, G q3 G q3 = I so that 
Qq(j) = I in (3.5b) if A(j) = I. The necessary condition (3.5e) is equivalent to 
assuming Kq(j), A(j), P q (j), Qq(j) and Rq(j) are known and optimizing over row 
unitary U q (j+1). That is, after dropping the index j and j+1 in (3.5e) we have the 
following result. 


Lemma 3.3 Suppose P q , Qq and R q in (3.7) are known. Then a necessary condi- 
tion for a row unitary matrix U q to achieve optimally for the problem: 

min tr[Q q U*P q U q + 2R q U q ]; U q e (3.11) 

is that there exists a symmetric matrix Q such that (3.6) is satisfied. 

Furthermore, the optimization in (3.1 1) is equivalent to 

min J(U); U e /f<VP«> x < r <rP«> (3.12a) 

where 


J(U) = tr[QU*PU + 2RU] 

over unitary matrices U* = [U* V* ] where Q = Qq and 


P = P = 


P q 0 
0 0 




R = [R q 0]e/? (r ' _p ' )x(r ’" p ’ ) 


(3.12b) 


□CD 

The advantage of the point of view (3.12) is that U ctin be treated as a square 
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matrix. The solution to (3.12) when U is a 2x2 unitary matrix is provided in the 
following lemma. The result can be derived by directly substituting into (3.12). 

Lemma 3.4 Suppose P = P = [py], Q = Q = [Qij] and R = [r^] are 2x2 matrices. 
Then the minimum in (3.12) over 2x2 unitary matrices U is achieved by either 

(i) U = diag{u!,u 2 } where u 2 = 1, uj = 1 minimize 

Jl =r ll u l r 22 u 2 + 2<ll2Pl2 u l u 2 (3.13) 


or(ii) 


X Vl-x^l 



where I x I £ 1 minimizes 

J 2 (x) = ax 2 + 2bx + 2(cx+d)Vl-x 5 


a = b - r u +r 22 


(3.14) 


c = qi 2 (Pll”P 22 ) + Pl 2 ( c l 22 — <11 1)* d - r 21 - r 12 

□cm 

Note that we must optimize over the disjoint sets of 2x2 unitary matrices consist- 
ing of signature matrices (as in (3.13)) and rotations (as in (3.14)). The optimal 
solution of (3.13) can be obtained by inspection of the magnitudes of the 
coefficients in Uj. For example, suppose 

I Tn I ^ ^ <ll2Pl2 ^ ^ 1*22^ 


Then 

u t = -sgn(r n ); u x u 2 = -sgn(q 12 p 12 ) 

However the optimization in (3.14) requires numerical solution. 

A general nxn unitary matrix U is either a signature matrix (i.e. a diagonal 
matrix £ such that £ 2 = I) or a product of l/2n(n-l) rotations Uy where the 
components of Uy(k,l) Uy are defined by 

Uy(i,i) = Uy(j j) = cos0y (3.15a) 
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U ij (ij) = -U ij OM)=sin0 ij 
Uij(k,k) = 1 for k * i, k * j 

Ujj(k,l) = 0 otherwise (3.15b) 

A particular signature matrix is also defined by (3.15b) where 

Uij(k,k) = ±l fork = ij 

Uij(k,l) = 0 fork*l (3.16) 

By letting 

U = nUij 
ij 

The optimization in (3.12) can be reduced to a sequence of one dimensional 
optimizations over the angles Gjj. To be complete, J(U) should also be evaluated 
separately for all 2 n (n = r q -p q ) signature matrices. A compromise during the 
iterative procedure is to include the possibility of components Uy being defined 
by (3.16) as well as (3.15a). Rather than present the general result we only illus- 
trate by means of an example. 

Specifically, suppose we express a 3x3 unitary matrix U as 

U = U12UJ3U23 (3.17) 

Then by invoking the trace property, J in (3.12b) can equivalently be expressed as 

J(Uy) = trtQyUijPjjUjj + 2R ij U ij ] (3.18a) 

where 

Q12 = U12U23QU23UJ3; Pj2 = P; R12 = L 23U13R 

Ql3 = U23QU23* ^13 = U12PU12* ^13 = t r 23^Uj2 (3.18b) 

Q23 = Q; P 2 3 = U 1 * 3 u; 2 PU 1 2U 1 3; R23 = RU 12 U 13 

With i = i 0 , and j = j 0 fixed in (3.18a), J can be optimization over Uy o . The pro- 
cedure is recursive. That is, first assume i = 1, j = 2 with U 13 and both initial- 
ized to (say) the identity. After optimizing over Uj 2 , fix U 12 and U 13 and optim- 
ize over U23, etc. Many cycles may be necessary for convergence. 

In order to explicitly demonstrate the formulation for each of the 2x2 optim- 
izations consider the case i = 1, j = 2, and express 
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Qi2“ 

Ql2 Ql2 

2 3 

y 

fo 

II 

1 2 

P 12 P 12 
2 3 

R 12~ 

1 2 

R 12 R 12 
4 3 


Q l2 Ql2 


P 12 P 22 


R 12 R 22 


i i 1 ,, 

where Qi2» p i2> R i2 e R • Then from (3.15), (3.16) the optimal 0 12 which 
minimizes J 12 OJ 12 ) also minimizes 

ji2@i2) = tr[Qi 2 UePi2Ue + 2(R 11 4Q 12 P 1 * 2 )U e ] 

where components of the 2x2 unitary matrix Uq is defined by (3.15a) or (3.16) for 
i, j, e { 1,2} The 2x2 optimization of J 12 (0i2) over 0 12 is partially solved in lemma 
3.4. 

Before concluding this section it is important to reiterate that the dimension 
of the problem for optimizing over the row unitary matrices U q is generally low. 
In particular from (1.21b) both the number of rows and columns of U q is not 
greater than the number of outputs. For a single output systems, U q is a scalar 
and so there are at most two possibilities, and no optimization is necessary. That 
is, for p q < r q we merely evaluate the cost in (2.24) for two values of G q in (1.21a) 
corresponding to U q = +1, while if p q = r q , then G q = G ql is unique. 

4. Coefficient Errors 

Recall that Y in (2.9) is the error in the covariance of the output (y(k)} due 
to finite precision implementation of both states and coefficients of the q-Markov 
COVER. The optimal q-FSWL Markov COVER minimizes the trace of Y when 
there are no coefficient errors (corresponding to y 0 = 0). Furthermore, when there 
are no coefficient errors, there are no errors in either the Markov parameters Mj or 
covariance parameters Rj in (1.2). Once coefficient errors are introduced and all 
finite wordlength (FWL) errors are considered, there is no longer a clear interpre- 
tation of what should constitute the optimal q-FSWL Markov COVER. One pos- 
sibility is to again attempt to minimize the trace of Y. Alternative performance 
criteria could be based on the errors AMj and ARj in the Markov and covariance 
parameters as given by 

Mj + AMj = (C+AC)(A+AA)'(B+AB); 

R + ARj = (C+AC)(A+AAyX(C+AC)* (4.1) 

where X satisfies X = AXA* + BB*. For example, one could attempt to minimize 
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C M = i tr[AM i (AM i )*] or C R ^ £ trIARJ (4.2) 

i=0 i=0 

However there are no results which directly connect C M or C R with errors in time 
or frequency response of the q-Markov COVERS. Furthermore, the analytical 
and computational aspects involved in the resulting optimization would be very 
difficult if not practically impossible. 

A convenient approach to parameter optimization is to assume a statistical 
model for parameter errors. A statistical design can be justified along the follow- 
ing lines. Suppose (as is the case in practice) that both the Markov parameters Mj 
and covariance parameters Rj are known only to be accurate up to a specified 
wordlength, and any higher precisional representation is regarded as uncorrelated 
random noise. Then the calculation of all q-Maricov COVERS (for a particular 
row unitary matrix U q ) will also only be accurate to a finite precision beyond 
which the parameter representation contains uncorrelated random noise. 

Lemma 4.1 Suppose M = M >0 and K = K* > 0 are given nxn matrices. Let 
Vj e R n be a zero mean random variable uniformly distributed between ±1 with 
uncorrelated components which are also uncorrelated with components of Vj. 
Then we have 

E { v/Mvj) = j tr[M] . (4.3) 

Furthermore 

E (tr[V*MVK)} = j tr[MK] (4.4) 

where 

V = [v 1 v 2 ••• v n ]e/f nxn . 

□CD 

Unfortunately these results cannot be applied directly to (2.9) since X itself is a 
random variable. However if we approximate X by X we can deduce the follow- 
ing result 

Theorem 4.1 

Suppose the components of 8A, SB and SC are zero mean uncorrelated ran- 
dom variables uniformly distributed between ±1. Then E{J) where J=tr[Y] is 


975 



- 22 - 


approximated by E{ J) where 

2 2 

E { J} = yMb’KB] + (y 2 + y )tr[K] + ^-(tr[XK]+tr[X]) (4.5) 

where K, X are defined by (2.1 1) and (1.3). 

nro 


Proof: From (2.9) ignoring the linear term in 8C 

J- 7 2 {tr[K] + tr[B*KB]) + 

Yo(tr[(8A)*X(8A)K]+tr[(8B)*K(8B)] + tr[(8C)*X8C] } 

The result then follows using Theorem 2.1. 

□□□ 

Under a similarity transformation T, the performance measure (4.5) becomes 

2 2 

E { J T ) = V 2 tr[B*KB] + (y 2 + y)tr[T*KT] + y (tr[XK] + tr\T ] l X(r 1 )*] (4.6) 

Note that both tr[B*KB] and tr[XK] are invariant. In fact the invariant eigen- 
values {o^} of XK are the squares of the Hankel singular values of the system 
defined by { A,B,C). Consequently we need only consider the minimization of 

2 2 

(V 2 + y)tr[T*KT] + y tr['T 1 X(T- 1 )*] (4.7) 

over similarity transformations T. We make use of an earlier result [8] to provide 
the minimum in (4.7). 

Theorem 4.2 [8] 

Consider a minimal asymptotically stable order system {A.B.C) with con- 
trollability grammian X and observability grammian K. Let X and K be the 
transformed grammians as a result of applying a similarity transformation T; that 
is 

X = 'r 1 X( r r 1 )*; K = T*KT (4.8) 

Then 
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tr[a 2 X+K] £ 2a £ a k (4.9) 

k=l 

A 

where {a k } are the Hankel singular values. Moreover equality is achieved in 
(4.9) if and only if 

K = a 2 X (4.10) 

In particular, in (4.7) 

min E {J T } = yVlB'KB] + ^-(£ o}+2a%v k ) (4.11a) 

T 3 k=l k=l 

where 

a=Vl + 3(7^ (4.11b) 

The minimum value is achieved in (4.11a) when K, X satisfy (4.10) with a given 
by (4.11b) 

mn 

One optimal realization (4.10) is a scaled internally balanced structure; that is 

Xj = a^diagfOj, a 2 , ...» a r< }; K^adiaglaj.Cj, (4.12) 

From the point of view of l 2 -scaling, equal diagonal components of X guarantee 

equal dynamic range of the state components. It is evident from (4.10) that any 
unitary transformation U applied to the coordinate basis having X and K as the 
respective controllability and observability grammians will not alter the optimal 
performance. Consequently an optimal realization in which all diagonal com- 
ponents of the controllability grammian are equal exists with controllability 
grammian U X 2 U and observability grammian U KjU such that 

U , XiUj j =-i- J <j k for all j (4.13) 

°“q fc=l 

where Xj, Kj are defined by (4.12) and U unitary. The existence of U is 
guaranteed by lemma 2.1 and an explicit algorithm for constructing a (nonunique) 
U is available in [9, Appendix A). 

Corollary 4.1 

The optimal q-FSWL COVER which minimizes (2.21) subject to the 12- 
scaling constraint 
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Air-^rLOk f°r*Uj C4.14) 

m q k=l 

also minimizes E { J x ) in (4.6) 

nm 

This result provides a connection between the optimal q-FSWL COVER structure 
which minimizes only the effects due to state quantization noise, and the subop- 
timal q-FWL Maikov COVER structure which minimizes E { J x ) subject to the 
assumed random parameter error model stated in Theorem 4.1. Once again we 
note that the result is suboptimal in the sense that X and X in (2.9) and (4.5) are 
only approximately equal. The result of Corollary 4.1 is also only of academic 
value since the l 2 -constraint (4.14) is not known until the design is complete since 
the Hankel singular values {oj} depend on the optimal row unitary matrix U p as 
provided in Theorem 2.1. However a more explicit result can be stated. 

Corollary 4.2 

The optimal q-FSWL cover subject to the l 2 -scaling constraint (2.22) also 
minimizes E (J T ) in (4.12) subject to (2.22). 

nm 


5. An Example 

Consider a 5 mode simply supported beam of length n having 2 inputs Uj, u 2 
and 2 outputs y lt y 2 

\ii = F(0.2ic,t) , u 2 = T(7t,t) 


yi = 0(0, t) , y 2 = p(0.6tt,t) 


where F(0.2jc,t) denotes a force applied at .2ic units from the left end of the beam, 
T(ic,t) denotes a torque at the right end of the beam, 0(O,t) denotes angular 
deflection at the left end, and p(0.6re,t) denotes rectilinear deflection at 0.6 tc from 
the left end of the beam. The equations of motion are assumed to be described by 


ti k + 2£ k C0kTlk + ®kHk = [sin(0.2itk) kcos(ick)] 


«i 

u 2 
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yi 

5 

kcos((htk) 

y\ 

= E 

k=l 

sin(0.67tk) 


ilk 


(5.1) 


where co^ = k 2 rads/sec. and £ = 0.005. A continuous time 10th order state space 
model is defined by 

x = Fx + Gu , y = Cx 

where 

X=0liT|iTl2Tl2 ”• Tlsns)* (5-2) 

A zero order hold equivalent 10th order discrete model (1.1) is defined by 

T 

A = e Fr ; B = Je Fo dcG 

O 

For the numerical work, a sampling period T = 0.025 sec. was selected which 
corresponded to approximately 10 samples in the shortest period. The eigen- 
values of A are at 

0.996±j0.0250, 0.9985±j0.0500, 0.9968±j0.0750, 0.9945±j0.0998, 0.99 16±j0. 1246 

Using the algorithm described in Corollary 1.1 the following results were 
obtained. 


q 

S q 

r q 

Pq 


2 

2 

4 

2 

) 

3 

2 

6 

4 

[ U q is 2x2 

4 

2 

8 

6 

) 

5 

2 

8 

8 

) 

6 

2 

9 

9 

[no freedom 

£7 

2 

10 

10 

) 


Hence for q = 2, 3, 4, U q in (1.22b) can be an arbitrary 2x2 unitary matrix, while 
for q > 5 there is no remaining freedom in the q-COVER. 

Optimal q-FSWL COVER designs: 

0 2 - 40° 

0 3 - 0 ° 

0 4 - 65° 


U q = 


cos0 q sin0 ( 
-sin0 q cos0, 


in0 q 
os0 q ’ 


(other cases 


1 0 
0 -1 


and 


-1 0 
0 1 


were also checked and neither was optimal). 
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The cost ranges from (2.29) for a = 1 were 

ifcopt = 0.3143X10 6 ^T| 2 ^ 0.8478X10 6 

n3opt = 0.2570x10* £ Tl 3 * 0.4764x10* 

^ = 0.0019x10® £ ti 4 £ 0.1308x10® 

The actual FWL output roundoff noise is given by 

A? 

where W bits are assigned to the fractional wordlength of the state. Hence a fac- 
tor of 4 improvement in T)q corresponds to a wordlength saving of 1 bit. There is 
little savings in this example when q = 2,3. However for q = 4 we have a saving 
of 4 bits. In practice, for fast sampling and low structural damping, the savings 
would increase as the dimension of the model increases (e.g. a simply supported 
beam of 50 modes with q = 8). 
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